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Abstract 


A straightforward extension of a solution to the decentralized linear-Quadratic-Gaussian problem is 
proposed that allows its use for commonly encountered classes of problems that are currently solved 
with the extended Kalman filter. This extension allows the system to be partitioned in such a way as 
to exclude the nonlinearities from the essential algebraic relationships that allow the estimation and 
control to be optimally decentralized. 


Introduction 


A distributed system consisting of K nodes interconnected via a communications network could be 
controlled using a decentralized controller framework that operates in parallel over the network. For 
such problems, a solution that minimizes data transmission requirements, in the context of state 
estimation of Gauss-Markov systems for distributed processing of local data and their integration 
for constructing optimal global estimates, has been given by Speyer [1]. In [1], the decentralized 
estimator was placed in a linear-quadratic-Gaussian (LQG) control setting. Generalizations of [1] 
may be found in [2] and [3], and in [4], this work served as the basis for a fault-tolerant multi- 
sensor navigation architecture. In [5], the decentralized LQG control is extended to the decentralized 
linear-exponential-Gaussian control which is related to deterministic Hoo control synthesis. 

As literally formulated in [1], the approach is valid for linear time-invariant systems only. As 
with the standard LQG problem, extension to linear time-varying systems requires that each node 
propagate its filter covariance forward and controller Riccati matrix backward at each time step. 
Furthermore, commonly used ad hoc techniques for problems with nonlinear state and output rela- 
tions such as the extended Kalman filter (EKF) violate certain linerity assumptions inherent in the 
decentralization of the estimation process developed in [1]. 

The contribution of this paper is to extend the linear decentralized controller of [l] in a somewhat 
similar fashion to the extended Kalman filter. This extension allows the system to be partitioned in 
such a way as to exclude the nonlinearities from the essential algebraic relationships that allow the 
estimation and control to be optimally decentralized. 
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Problem Statement 


It is desired to minimize over U*(t),j = 1,2,... , K , 
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In some applications, it may be desired to control only some linear combination of the state 
deviations from the reference, 

z(t) = M[X(t) - X R (t)] (9) 
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The state estimate X t is generated by the “continuous/discrete” extended Kalman filter: 
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where Yi = [T) 1 ; V^ 2 ; . . . , V) A ] , g = [<7* ! 9 2 ', • • • 1 ]> Pi — diag({R\ , R^ ]), and 
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Problem Solution 


As in [1], decompose the state space into a control-dependent partition and a data-dependent parti- 
tion: 


Xi = X c (u) + x 
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X(ti) — X c (t{) + X c (ti) — Xiy x (^i) — 0 
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then a local, linearized Kalman filter (LKF) operating only on the local data is 


Kf = P%)[Hl]\Hjpi(U)[Hi] J + Ri)' u , P j (h) = Pi 

x? j = ^ i {U) + Ki[%-H{xPi{ti)] 

PI = (I-KjHj)P j (U)(I-KiHi) J + K 3 R 3 (K 3 ) J 
x Dj (t) = 

P j (t) = + Qd{t,U) 
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Note that Eqs. 29 - 31 can be iterated by evaluating Eq. 34 with the previous iteration’s value for 
xf 3 in place of x Dj (ti). In some applications, the accuracy of if 3 can thus be improved. 

Now the algorithm of [1] can be utilized. This algorithm is based on writing x- as a linear 
combination of the local estimates if 3 and an additional data-dependent vector calculated locally: 
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The essense of the algorithm of [1] is that one need not reconstruct the globally optimal state if 
via Eq. 35 if one only needs to compute the globally optimal control. Instead, define 


a? = [Sfc + ,,I.)] T S, «*('.+..<<) [P.(P/)-‘if j + h‘ 


(39) 
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Then, Eqs. 11 and 12 can be rewritten as 

W(u) = [Vj(ti+i,ti) + [B 3 d (ti+i,ti)] T Si+iB } d (ti+i,ti)] (40) 

X |[Bj(( i+I ,( i )] T 5 i+ ,»(i i+ „i,)[^f - A' R (t.)] + £>f } + 

Note that even though the approach does not require a global Kalman filter, it does require the 
global covariance matrix P, in Eqs. 37, 38, and 39. Fortunately, Eqs. 21 and 23 do not lequiie the 

measurement data, but Eq. 21 does require knowledge of the information contribution of each node, 

This consideration will be addressed below. 

Chang [7] shows that at least Eqs. 36 and 38 can be avoided if instead of maintaining both x? J 
and h\ independently, they are combined in a single vector, defined as follows: 

ft = P t (pi)- l x^ + hi (41) 

so that 

a? = [B5(i i+1 ,«i)] T a-+i*(‘i+i.<i)^ < 42 ) 

Reference [7] shows that a recursion for ft is 

ft = Fift(U) + Kfyf ; ft{t) = $(i, t ,-)#, ft = 0 (43) 

If there is no reason to maintain a locally optimal state estimate, then Eqs. 30 and 32 can also be 
avoided. 

Remarks 

Note that the nonlinear state and output relations, Eqs. 2 and 4, appear nowhere in Eqs. 35-41. 
Partitioning all of the initial condition information into X c allows the local Kalman filter to directly 
operate only on x Dj and hence remain linear. 
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In either the original, linear formulation or the current extended formulation, the control dependent 
and data-dependent partitions of the state will tend to individually diverge from the truth as more 
data are incorporated and more controls are executed. This is not an issue for the linear problem, 
but in the present case, it could cause the linearizations to be compromised. Therefore, it is impor- 
tant that evaluations of partial derivatives such as Eqs. 34 and 17 be evaluated on either the desired 
trajectory X R or the locally optimal whole state estimate, X c + x Dj . An iterated update may also 
be desirable. 

In certain applications, the control may only be active during a finite time interval, but the esti- 
mator may nevertheless continue to operate at all times. In such circumstances, it may be appropriate 
to revert to the EKF when the controller is inactive. Then, as each actuation epoch arrives, the LKF 
would be re-initialized using the latest EKF state estimate. 

As mentioned previously, the local reconstruction of the globally optimal control requires that the 
covariance of the global state estimate, although not the global state estimate itself, be maintained 
at each node. This presents some difficulties. The measurement partial derivatives for the non- 
local nodes, H-, l ^ j, are required by Eq. 21. According to Eq. 34, the non-local data-dependent 
state partitions, x De , are required, implying an additional inter-node communication requirement. 
However, as mentioned above, Eq. 34 can instead be evaluated on the desired trajectory A^, which 
is the same at all nodes. This procedure will however deny the possibility of an iterated update. In 
fact, it could be argued that the globally optimal covariance should be computed using the globally 
optimal data-dependent state partition, x D , which is unavailable at any node. In practice, it may be 
adequate to merely compute 77/, £ ^ j using local information, accepting the induced suboptimality 
in the reconstruction of the global covariance. 

A more significant practical issue with the local reconstruction of the globally optimal covariance 
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is that the measurement updates may not occur at uniform intervals at all the nodes. In fact, if 
as is typical, the local Kalman filters employ an editing procedure, the covariance update interval 
becomes non-deterministic. These issues can be addressed by requiring the additional transmission 
of a semaphore from each node to all the other nodes every time a local measurement is successfully 
incorporated. The semaphore can be as simple as a single bit, which when positive, indicates that the 
global covariances at the other nodes should be updated to reflect that a measurement was processed 
by the node transmitting the semaphore. 

In [2], reference [1] is significantly generalized, and it is shown that the local estimators need 
not share the state space of the implicit globally optimal centralized estimator, under the restriction 
that linear relationships among the elements of the measurement vector present in the global model 
are preserved in the local model. A restricted subset of such conditions is the case in which the 
local model’s states are a subset of the global model’s states. The present work applies only to this 
restricted case. 


Conclusions 

A straightforward, ad-hoc extension of [1] is proposed that allows its use for commonly encountered 
classes of problems that are currently solved with the extended Kalman filter. As such, the proposed 
approach shares many of the limitations of the KKF, such as a lack of guaranteed stability. Keveithe- 
less, it can be expected that the wide successful usage of the EIvF implies that the current approach 
will suffice for many problems of practical interest. 
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